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REDUCTION OF CHROMATIC BLEEDING ARTIFACTS IN 
IMAGES CONTAINING SUBSAMPLED CHROMINANCE 

VALUES 

5 

BACKGROUND OF THE INVENTION 
The present invention relates to digital images. More specifically, the 
present invention relates to the reconstruction of compressed images. 

Image compression according to JPEG and certain other image 
10 compression algorithms is performed by converting images to luminance and 
chrominance channels and subsampling the chrominance channels (Cb and 
Cr) by an integer factor (usually 2 or 4). The luminance and subsampled 
chrominance channels are then compressed by a compression module 
suitable for grayscale image. The chrominance channels may be subsampled 
15 because the human visual system (HVS) has a reduced spatial sensitivity of 
chromatic sensation relative to luminance sensation by roughly a factor of two. 
Consequently, chromatic bleeding artifacts resulting from the sub-sampling 
are virtually unnoticeable in most color photographs that contain subsampled 
chrominance values. 

20 However, chromatic bleeding artifacts are noticeable in color compound 

document images, which frequently contain sharp edges between different 
colors. For example, a color compound document might have text or other 
computer-generated shapes that are overlaid on regions having uniform color. 
The sharp edges occur at the transitions of the computer-generated images 

25 and the photographs. 

The chromatic bleeding artifacts are noticeable if the reconstructed 
chrominance-channels are interpolated back to their original resolution by a 
simple technique such as linear interpolation. The chromatic bleeding artifacts 
are seen at boundaries between regions with saturated colors and white 

30 regions (or regions with bright colors). In document images, these boundaries 
are often between a white or bright background and color characters, lines 
and patches. 
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The chromatic bleeding artifacts are also noticeable in regions 
containing inverted text (e.g., white characters on a colored background). Due 
to the properties of the human visual system, the chromatic bleeding artifacts 
are visible on the brighter side of the edge. 
5 The chromatic bleeding artifacts reduce image quality. Therefore, it 

would be desirable to reduce the chromatic bleeding artifacts, especially in 
color compound document images. 



10 SUMMARY OF THE INVENTION 

According to one aspect of the present invention, chromatic bleeding 
artifacts in a digital image are reduced by modifying chrominance values of at 
least some pixels in the digital image. The pixels are modified according to 
luminance values and chromatic dynamic range. 

15 Other aspects and advantages of the present invention will become 

apparent from the following detailed description, taken in conjunction with the 
accompanying drawings, illustrating by way of example the principles of the 
present invention. 



20 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is an illustration of a method of reconstructing an image and 
reducing chromatic bleeding artifacts in the reconstructed image; 
Figure 2 is an illustration of a local neighborhood of pixels; 
25 Figures 3(a) to 3(d) are illustrations of a sliding window for determining 

chromatic dynamic ranges of pixels in a reconstructed image that has been 
interpolated by pixel replication; and 

Figure 4 is an illustration of a hardware implementation of the method of 
Figure 1 . 
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DETAILED DESCRIPTION OF THE INVENTION 
As shown in the drawings for purposes of illustration, the present 
invention is embodied in a method and apparatus for reducing chromatic 
bleeding artifacts in digital images containing subsampled chrominance 
5 values. The method and apparatus are particularly suited for reducing 
chromatic bleeding artifacts in color compound document images containing 
both natural and computer-generated features. Natural features in photo 
regions tend to have mild luminance or chrominance transitions. Computer- 
generated features such as text regions tend to have sharp edges and sharp 
10 luminance or chrominance transitions. The method and apparatus reduce the 
chromatic bleeding artifacts that occur at the sharp edges. 

Reference is made to Figure 1, which illustrates a method of 
reconstructing a compressed image and reducing chromatic bleeding artifacts 
in the reconstructed image. The compressed image includes a first stream of 
15 compressed luminance (Y) values and second and third streams of 
compressed chrominance (Cb and Cr) values. Prior to compression, the 
chrominance channels were either subsampled or low-pass filtered and then 
subsampled. 

The image reconstruction begins by accessing the first, second and 
20 third streams of compressed values (block 102). The luminance values (Y) 
are reconstructed from the first stream (block 104) and the chrominance 
values (Cb and Cr) are reconstructed from the second and third streams 
(block 106). 

The luminance and chrominance values will hereinafter be described 
25 with respect to normalized values. For the luminance values, 0 < Y < 1. For 
the chrominance values, -0.5 < Cb < 0.5 and -0.5 < Cr < -0.5. The point 
Cb=Cr=0 corresponds to the gray-axis (no color). 

Since the chrominance values (Cb and Cr) were subsampled during 
compression, the reconstructed chrominance channels are interpolated or 
30 upsampled to their original resolution to match the resolution of the luminance 
channel (block 108). A simple interpolation method is pixel replication, where 
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every low-resolution pixel is replaced by a 2x2 block of high-resolution pixels 
having the same chrominance values (Cb and Cr). A more sophisticated 
upsampling method involves applying low-pass filtering on the pixel-replicated 
chrominance channels for reducing aliasing artifacts in locations of high spatial 
5 frequency, such as edges. 

Chromatic bleeding artifacts in the reconstructed digital image are 
reduced by modifying chroma values of at least some of the pixels in the 
digital image. The chroma value of a pixel is modified with respect to the 
pixel's luminance value and local chromatic dynamic range (block 110); and 
10 the chrominance values (Cb and Cr) are scaled according to the change in 
chroma value (block 112). Modifying the chroma value with respect to 
chromatic dynamic range is performed so as not to reduce chromaticity too 
much in regions with essentially uniform light colors. 

The reconstructed luminance and chrominance channels may be 
15 converted back to RGB space at the original resolution. The reconstructed 
image may then be displayed (e.g., printed). 

The local chromatic dynamic range of a pixel is determined with respect 
to its local pixel neighborhood. Figure 2 provides an example of a 
neighborhood of pixels. The neighborhood, delineated by a window indicated 
20 in dashed lines, includes a 3x3 array of pixels. The pixel of interest, marked 
by an "X," lies at the center of the neighborhood. 

The chromatic dynamic range for each pixel of interest may be 
computed as the difference between minimum and maximum chroma values 
of the pixels in the local neighborhood. The chroma value (C) of a pixel may 

25 be computed as C = yfcf+cf or the chroma value (C) may be approximated 

by C«|Q| + |C r | where the allowed value range for each of the chrominance 

values is [-0.5,0.5]. The chromatic dynamic range of a neighborhood may be 
computed as D = C M - C m where C m represents the minimum chroma value of 
the neighborhood and C M represents the maximum chroma value of the 
30 neighborhood. 
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A neighborhood and chromatic dynamic range are determined for each 
pixel of interest. Consequently, the chromatic dynamic range is determined on 
a pixel-by-pixel basis. 

A new chroma value (C) for a pixel of interest may be computed as 
5 C'=C- f(Y,D)-(C-C Q ) , where C is the original chroma value for the pixel, D 

is the chromatic dynamic range, C 0 is a chromatic modulus having a value 
between zero and the minimum chroma of the local neighborhood for the 
pixel, and f(Y,D) is a parametric expression that determines the amount of 
relative chroma reduction. 
10 The parametric expression f{Y,D) may range between 0 and 1. The 

parametric expression f(Y 9 D) complies with the following constraints: (1) 
f(Y 9 D)-> 1 for Y -» 1 , whereby C'->C 0 ; and (2) f(Y,D)-> 0 for D ^ 0. If 

D-»0, then C'->C, whereby the chroma value for the pixel is not modified. 

The parametric expression f(Y,D) may also comply with another 

15 constraint: f(Y,D)-> 0 for D -> 0 and Y->1. Thus, the chromatic dynamic 
range takes precedence. 

If the chroma value is modified, each corresponding chrominance value 

o c 

(Cb and Cr) is scaled by the ratio CYC. Thus, CV=—Cb and Cr'= — Cr. This 

C C 

keeps the hue of the color unchanged. 

20 Consider different cases for the chromatic modulus (C 0 ). In a first case 

C 0 =C m , whereby C=C-f(Y,D)-(C-C m ) and the new chroma value (C) lies 
between the original chroma value (C) and the neighborhood minimum (CJ. 
For high luminance Y->1, the new chroma value (C) approaches the local 
minimum (C m ). Thus C'~->C m as Y-»1 . 

25 In a second case, C 0 = max (C m -D, 0). Such a modulus C 0 allows the 

new chroma value (C) to fall below the local minimum (C m ). However, the 
chroma value is still dependent upon the chromatic dynamic range (D). The 
chromatic modulus (C 0 ) is not reduced below C m -D. If C m <D, the chromatic 
modulus (C 0 ) becomes zero. For chromatic dynamic ranges that are not 
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small, the situation C m <D corresponds to edges between "non-colored" and 
"saturated color" regions. In this situation, the chroma value may be reduced 
to zero if the "non-colored" side is close to white. On the other hand, the 
situation C m >D could correspond to an edge between a "mild-color" and a 
5 "saturated-color" where the visibility of color-bleeding artifacts is not high to 
start with. In this situation, allowing the chroma value to be reduced to zero 
would reduce too much color in the lighter side of the edge. Putting a lower 
bound C m -D on the modified chroma value ensures that in color gradient 
regions ("mild edges") where the chromatic dynamic range (D) is neither very 
10 small or very large, the chroma value will not be reduced significantly when the 
luminance Y->1 . 

In the third case, C 0 =0. For high luminance Y-»1, the new chroma 
value (C) approaches 0. Thus C'->0 as Y->1 . 

The parametric expression may be expressed in different ways. An 



15 exemplary parametric expression is f(Y 9 D) = max 
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The 



exemplary parametric expression always complies with the two constraints: 
/(y->l,2J)->1 and f(Y,D ->0)-»0 f regardless of the value of the term a 

(where a is positive). 

For a given value of D, there is a luminance value (Y) below which the 
20 chromatic bleeding artifacts are not visible. If a chromatic bleeding artifact is 
not visible for a given D, the value of the term a may be chosen such that 
f(Y,D) =0. For example, the chroma value is not modified if Y<(1-D/a). That 

is, C'=C if Y< T Y (D), where threshold T Y (D) =(1-D/ot). 

The term a may be a function of the chromatic dynamic range (D). A 
25 term a may be measured for each value of D. Each term a may be measured 
from subjective tests (e.g., observing visibility of artifacts in patches). 

In the alternative, the term a may be constant for all D. The value for 
the term a can be determined by trial and error. For example, 0.5<a<1 has 
been found to work well. 
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Thus disclosed is a method for reducing the chrominance magnitude in 
pixels that would generate a visual perception of chromatic bleeding. By 
taking luminance and local chrominance values into account, the method does 
not modify patches that have high luminance values and non-negligible 
5 chrominance values. A flat region might have relatively high luminance but 
also non-negligible chrominance. The method would not map such a region to 
white. A document image might have text boxes with light colored 
backgrounds. The method would not map the light backgrounds to white. 

The method is particularly useful for reducing chromatic bleeding 
10 artifacts in compound color documents. However, the method is not so limited. 

Although Figure 2 shows a 3x3 square-shaped neighborhood, the 
method is not limited to such a neighborhood. The neighborhood is not limited 
to any particular size. The number of pixels is not limited to nine. Although a 
fixed number of pixels in the neighborhood is preferred for all pixels of interest, 
15 the size of the neighborhood may be changed dynamically to accommodate a 
particular class of image region (e.g., text, graphics, natural features). 

The neighborhood is not limited to any particular geometry, although 
square windows are preferred for performance reasons. For example, the 
shape of the neighborhood may be diamond-shaped. The minimum/maximum 
20 calculations may include the center pixel (that is, a full neighborhood may be 
used) or the minimum/maximum calculations may exclude the center pixel of 
interest (that is, a hollow neighborhood may be used). 

The method has been described in connection with decomposing a 
digital image into visually significant channels (e.g., luminance and blue and 
25 red chrominance channels). However, the method is not limited to YCbCr 
color space. For example, the method may be applied in Yuv, Luv or Lab 
color space (where L represents luminosity). 

In the method described above, much of the computational effort is 
devoted towards computing the chromatic dynamic range for each pixel in a 
30 neighborhood. However, the computational effort can be reduced, and the 
speed of the method increased, by using subsampled chrominance values 
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and thus taking advantage of redundancy. 

Reference is now made to Figures 3(a) to 3(d), which show a sliding 
window for determining chromatic dynamic ranges of pixels in a reconstructed 
image that has been interpolated by pixel replication. During the interpolation, 
5 a first pixel in the reconstructed luminance channel is replaced by a 2x2 block 
of pixels C1, a second pixel in the reconstructed luminance channel is 
replaced by a 2x2 block of pixels C2, a third pixel in the reconstructed 
luminance channel is replaced by a 2x2 block of pixels C3, and a fourth pixel 
in the reconstructed luminance channel is replaced by a 2x2 block of pixels 
10 C4. 

The pixels in every 2x2 block in the upsampled chrominance channels 
contain exactly the same chrominance value. As Figures 3(a) to 3(d) show, 
each 4x4 block in the upsampled chrominance channel which is aligned with 
2x2 block boundaries, has four possibilities of accommodating 3x3 

15 neighborhoods. For each of these four possibilities, the neighborhood 
minimum (or maximum), and the chromatic dynamic range of the 
neighborhoods are the same, since they are calculated from the same four 
chromatic modulus values. The four chromatic modulus values correspond to 
the four double-sized pixels, where each such pixel corresponds to a pixel in 

20 the sub-sampled chrominance channels. Thus, the computational complexity 
is reduced to finding the maximum and minimum in 2x2 neighborhoods in the 
subsampled chrominance channels. This reduces by a factor of four the 
number of chrominance modulus calculations, and reduces by a factor of 
sixteen the number of comparisons needed for calculating the minimum and 

25 maximum chroma values (C m and C M ) of the neighborhoods. If pixel- 
replication is to be used in this manner, it is preferable to apply low-pass 
filtering on the chrominance channels prior to their subsampling. For example, 
every 2x2 block of the original chrominance channels could be replaced by the 
average or the median of the four chrominance-values in that block. 

30 The computational effort may be reduced in other ways. For example, 

if the difference between the new chroma value (C) and the original chroma 
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value (C) is imperceptible, little will be gained by modifying the chroma value. 
Therefore, the parametric expression is not computed and the chroma value is 
not modified if the difference is imperceptible. For example, C'=C if (C-C 0 )< T, 
where T is a predetermined threshold. If the chromatic dynamic range (D) is 
5 computed with a fast recursive algorithm, it is calculated for all pixels. 
Therefore, little overhead is incurred by performing the comparison D<T. An 
exemplary threshold is T=0.1 (for normalized chrominance values). 

The method may be implemented in hardware, software or a 
combination of the two. 

10 Reference is now made to Figure 4, which illustrates a software 

implementation of the method. Computer memory 212 stores a program 214 
that, when executed, instructs a processor 216 to perform the method 
described above. The memory 212 and the processor 216 may be part of a 
personal computer or workstation. 

15 A non-recursive algorithm may be used to determine the minimum and 

maximum chroma values of pixel neighborhoods. The non-recursive algorithm 
may be used for all types of neighborhoods. The size of the memory needed 
to determine the minimum and maximum values is equal to the size of the 
neighborhood. 

20 A fast recursive algorithm may be used to determine the minimum and 

maximum chroma values of full square neighborhoods (e.g., 2x2 
neighborhoods, 3x3 neighborhoods, 5x5 neighborhoods). Except for the 2x2 
neighborhood, only twelve comparisons are needed to determine the 
maximum and minimum chroma values of a neighborhood, regardless of the 

25 size of the neighborhood. In the case of the 2x2 neighborhood, only three 
comparisons are needed. If this recursive algorithm is used, the size of 
memory needed to buffer the lines is equal to twice the size of the lateral 
kernel window. 

The present invention is not limited to the specific embodiments 
30 described and illustrated above. Instead, the invention is construed according 
to the claims that follow. 



-9- 



PATENT 
PDNO 10007351-1 



WHAT IS CLAIMED IS: 

1 . A method of reducing chromatic bleeding artifacts in a digital image, 
the method comprising modifying chrominance values of at least some pixels 
in the digital image, the pixels being modified according to its luminance 
values and chromatic dynamic range. 

2. The method of claim 1 , wherein the chromatic dynamic range for 
each pixel is a function of minimum and maximum chroma values of a local 
pixel neighborhood, whereby the chromatic dynamic range is determined on a 
pixel-by-pixel basis. 

3. The method of claim 1 , wherein the chrominance values of a pixel 
are scaled by the ratio CYC if the original chroma value (C) of the pixel is 
modified, where C is the new chroma value. 

4. The method of claim 1 , wherein a chroma value of a pixel is 
modified to no more than the minimum of the local neighborhood if the pixel 
has a high luminance, and wherein the chroma value of a pixel is not modified 
if the pixel has a small dynamic range. 

5. The method of claim 1 , wherein the chrominance values of at least 
some pixels are modified by C=C- f(Y y D)-(C-C 0 ), where C is the new 
chroma value of the pixel, C is the original chroma value of the pixel, Y is the 
luminance of the pixel, D is the chromatic dynamic range, C 0 is a chromatic 
modulus having a value between zero and C m , C m is the minimum chroma of 
the local neighborhood for the pixel, and f(Y,D) is a parametric expression 
that determines the amount of relative chroma reduction. 
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6. The method of claim 5, wherein f(Y 9 D) complies with/(F 5 £>)-> 1 
for Y -> 1 ; and f(Y,D) -» 0 for D 0. 

7. The method of claim 6, wherein f(Y,D) also complies with 
f(Y,D) -> 0 for D -> 0 and Y->1 . 

8. The method of claim 5, wherein C 0 = max[C m -D,0]). 

9. The method of claim 5, wherein the modulus C 0 = C m . 

10. The method of claim 5, wherein C 0 =0. 



1 1 .The method of claim 5, wherein f(Y,D) = max 
a is a positive term, 
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, where 



12. The method of claim 11, wherein C'=C if Y<(1-D/a). 

13. The method of claim 1 , wherein each pixel of interest is mapped by: 
determining a chromatic dynamic range; 

leaving the pixel unmodified if the chromatic dynamic range is less than 
a predetermined threshold; and 

computing a parametric function if the chromatic dynamic range is 
greater than the threshold and using the parametric function to modify the 
chrominance value of the pixel, the parametric function being a function of the 
luminance and local chromatic dynamic range of the pixel. 



14. The method of claim 1, wherein the digital image is reconstructed 
from subsampled chrominance values; and wherein the chromatic dynamic 
range is determined from subsampled chrominance values. 
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15. A method of reconstructing a digital image from a luminance 
channel and subsampled chrominance channels, the method comprising: 

interpolating the chrominance channels; and 

reducing chromatic bleeding artifacts from the interpolated chrominance 
5 channels by modifying chrominance values of at least some pixels in the 
digital image, the pixels being modified according to its luminance values and 
chromatic dynamic ranges. 

16. Apparatus for reducing chromatic bleeding artifacts in a digital 
image, the apparatus comprising a processor for modifying chrominance 
values of at least some pixels in the digital image, the pixels being modified 
according to luminance values and chromatic dynamic ranges. 

17. The apparatus of claim 16, wherein the chromatic dynamic range for 
each pixel is a function of minimum and maximum chroma values of a local 
pixel neighborhood; and wherein the processor determines local chromatic 
dynamic ranges on a pixel-by-pixel basis. 

18. The apparatus of claim 17, wherein the processor scales the 
chrominance values of a pixel by the ratio CYC if the original chroma value (C) 
of the pixel is modified, where C is the new chroma value. 

19. The apparatus of claim 17, wherein the processor modifies a 
chroma value of a pixel to no more than the minimum of the local 
neighborhood if the pixel has a high luminance, and wherein the processor 
does not modify the chroma value of a pixel if the pixel has a small dynamic 

5 range. 
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20. The apparatus of claim 17, wherein the chrominance values of at 
least some pixels are modified by C=C-f(Y,D)>(C-C 0 ), where C is the 

new chroma value of the pixel, C is the unmodified chroma value of the pixel, 
Y is the luminance of the pixel, D is the local chromatic dynamic range, C 0 is a 
chromatic modulus having a value between zero and C mJ C m is the minimum 
chroma of the local neighborhood for the pixel, and f(Y 9 D) is a parametric 
expression that determines the amount of relative chroma reduction and that 
ranges between 0 and 1 . 

21. The apparatus of claim 20, wherein f(Y 9 D) complies with 
f(Y 9 D) -> 1 for Y 1 ; and f(Y 9 D) 0 for D -» 0. 

22. The apparatus of claim 21, wherein f(Y 9 D) also complies with 
f(Y,D) — » 0 for D -> 0 and Y->1 . 

23. The apparatus of claim 20, wherein C 0 = max[C m -D,0]). 

24. The apparatus of claim 20, wherein the modulus C 0 =C m . 

25. The apparatus of claim 20, wherein C 0 =0. 



26. The apparatus of claim 20, wherein f(Y,D) = max 
where a is a positive term. 
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27. The apparatus of claim 26, wherein C'=C if Y<(1-D/a), 
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28. The apparatus of claim 16, wherein the processor reconstructs the 
digital image from subsampled chrominance values; and wherein the 
processor determines the chromatic dynamic ranges from the subsampled 
chrominance values. 

29. An article of manufacture for a processor, the article comprising: 
computer memory; and 

a program stored in the memory, the program, when executed, causing 
the processor to reduce chromatic bleeding artifacts in a digital image by 
modifying chrominance values of at least some pixels in the digital image, the 
pixels being modified according to its luminance values and chromatic 
dynamic range 
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REDUCTION OF CHROMATIC BLEEDING ARTIFACTS IN 
IMAGES CONTAINING SUBSAMPLED CHROMINANCE 

VALUES 

ABSTRACT OF THE DISCLOSURE 
Chromatic bleeding artifacts in a digital image are reduced by modifying 
chrominance values of at least some pixels in the digital image. The 
chrominance values are modified according to luminance values and 
chromatic dynamic range. 
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information as defined in Title 37, Code of Federal Regulations, Section 1.56(a) which occurred between the filing date of the prior 
application and the national or PCT international filing date of this application: 
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POWER OF ATTORNEY: 

As a named inventor, i hereby appoint the following attorney^} and/or agentls) to prosecute this application and transact all 
business in the Patent and Trademark Office connected therewith*. 
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Sand Correspondence to: 
HEWLETT-PACKARD COMPANY 
Intellectual Property Administration 
P.O. Box 272400 

Fort Collins, Colorado 80528-9599 



Direct Telephone Calls To: 

Hugh P. Gortler, (949) 454-0898 
Susan E. Heminger, (650)236-2738 



I hereby declare that all statements made herein of my own knowledge are true and that all statements 
made on information and belief are believed to be true; and further that these statements were made 
with the knowledge that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful 
false statements may jeopardize the validity of the application or any patent issued thereon. 



Full Name of Inventor: Ron Maurer 
Residence: 
Post Office Address: 



Citizenship: 



Israel 



17 Tveria Street, #14, Haifa, Israel 33314 



17 Tveria Street, #14, Haifa, Israel 33314 
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